Generalized maximum entropy estimation

نویسندگان

  • Tobias Sutter
  • David Sutter
  • Peyman Mohajerin Esfahani
  • John Lygeros
چکیده

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel approximation scheme using a smoothed fast gradient method that is equipped with explicit bounds on the approximation error. We further demonstrate how the presented scheme can be used for approximating the chemical master equation through the zero-information moment closure method.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Generalized Maximum Entropy Stochastic Frontier Measuring Productivity Accounting for Spatial Dependency

In this paper, a stochastic frontier model accounting for spatial dependency is developed using generalized maximum entropy estimation. An application is made for measuring total factor productivity in European agriculture. The empirical results show that agricultural productivity growth in Europe is driven by upward movements of technology over time through technological developments. Results ...

متن کامل

An application of general maximum entropy to utility

Methodologies related with information theory have been increasingly used in studies in economics and management. In this paper we use Generalized Maximum Entropy as an alternative to the Ordinary Least Squares in the estimation of utility functions. We estimated linear, logarithmic and power utility functions as well as confidence intervals and in order to compare both methodologies. Results p...

متن کامل

Modeling of the Maximum Entropy Problem as an Optimal Control Problem and its Application to Pdf Estimation of Electricity Price

In this paper, the continuous optimal control theory is used to model and solve the maximum entropy problem for a continuous random variable. The maximum entropy principle provides a method to obtain least-biased probability density function (Pdf) estimation. In this paper, to find a closed form solution for the maximum entropy problem with any number of moment constraints, the entropy is consi...

متن کامل

Duality of Maximum Entropy and Minimum Divergence

We discuss a special class of generalized divergence measures by the use of generator functions. Any divergence measure in the class is separated into the difference between cross and diagonal entropy. The diagonal entropy measure in the class associates with a model of maximum entropy distributions; the divergence measure leads to statistical estimation via minimization, for arbitrarily giving...

متن کامل

Parameter estimation for 3-parameter generalized pareto distribution by the principle of maximum entropy (POME)

Abstract The principle of maximum entropy (POME) is employed to derive a new method of parameter estimation for the 3-parameter generalized Pareto (GP) distribution. Monte Carlo simulated data are used to evaluate this method and compare it with the methods of moments (MOM), probability weighted moments (PWM), and maximum likelihood estimation (MLE). The parameter estimates yielded by the POME ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1708.07311  شماره 

صفحات  -

تاریخ انتشار 2017